OpenStack Ocata : How to use Manila
2017/03/18 |
This is How to use OpenStack Shared File System (Manila).
This example is based on the emvironment like follows.
For example, Configure local block device as shared storage on Storage Node and use it from Instances.
Therefore, it needs there is a free block device on Storage Node.
------------+--------------------------------+--------------------------------+------------ | | | eth0|10.0.0.30 eth0|10.0.0.50 eth0|10.0.0.51 +-----------+-----------+ +-----------+-----------+ +-----------+-----------+ | [ Control Node ] | | [ Storage Node ] | | [ Compute Node ] | | | | | | | | MariaDB RabbitMQ | | Open vSwitch | | Libvirt | | Memcached httpd | | L2,L3,Metadata Agent | | Nova Compute | | Keystone Glance | | Manila Share | | L2 Agent | | Nova API | | | | | | Neutron Server | | | | | | Manila API | | | | | +-----------------------+ +-----------------------+ +-----------------------+ |
[1] | Configure Storage Node. |
root@storage:~#
apt-get -y install lvm2 nfs-kernel-server # create a volume for Manila on free block device root@storage:~# pvcreate /dev/sdb1 Physical volume "/dev/sdb1" successfully created root@storage:~# vgcreate manila-volumes /dev/sdb1 Volume group "manila-volumes" successfully created
root@storage:~#
vi /etc/manila/manila.conf # add follows into [DEFAULT] section
enabled_share_backends = lvm
# add to the end [lvm] share_backend_name = LVM share_driver = manila.share.drivers.lvm.LVMShareDriver driver_handles_share_servers = False lvm_share_volume_group = manila-volumes lvm_share_export_ip = 10.0.0.50 systemctl restart manila-share nfs-server root@storage:~# systemctl enable manila-share nfs-server
|
[2] | Create default share type. It's OK to work on any node. (This example is on Control Node) |
root@dlp ~(keystone)# manila type-create default_share_type False +----------------------+--------------------------------------+ | Property | Value | +----------------------+--------------------------------------+ | required_extra_specs | driver_handles_share_servers : False | | Name | default_share_type | | Visibility | public | | is_default | - | | ID | 98accd2e-b951-448b-9467-10a6e9aaa374 | | optional_extra_specs | | +----------------------+--------------------------------------+root@dlp ~(keystone)# manila type-list +-----------+--------------------+------------+------------+--------------------------------------+----------------------+ | ID | Name | visibility | is_default | required_extra_specs | optional_extra_specs | +-----------+--------------------+------------+------------+--------------------------------------+----------------------+ | 98accd2e- | default_share_type | public | YES | driver_handles_share_servers : False | | +-----------+--------------------+------------+------------+--------------------------------------+----------------------+ |
[3] | Create NFS share. |
root@dlp ~(keystone)# manila create NFS 10 --name share01 +---------------------------------------+--------------------------------------+ | Property | Value | +---------------------------------------+--------------------------------------+ | status | creating | | share_type_name | default_share_type | | description | None | | availability_zone | None | | share_network_id | None | | share_server_id | None | | share_group_id | None | | host | | | revert_to_snapshot_support | False | | access_rules_status | active | | snapshot_id | None | | create_share_from_snapshot_support | False | | is_public | False | | task_state | None | | snapshot_support | False | | id | 96368e55-c8a0-41ef-ab96-31300df0da34 | | size | 10 | | source_share_group_snapshot_member_id | None | | user_id | 6ecb1a2e5f664d508afac2b985508a0d | | name | share01 | | share_type | 98accd2e-b951-448b-9467-10a6e9aaa374 | | has_replicas | False | | replication_type | None | | created_at | 2017-03-20T02:29:34.000000 | | share_proto | NFS | | mount_snapshot_support | False | | project_id | ef6b5d01da394383a1afba725735a727 | | metadata | {} | +---------------------------------------+--------------------------------------+ # few minutes later, the Status turns to available root@dlp ~(keystone)# manila list +-----------+---------+------+-------------+-----------+-----------+--------------------+---------------+-------------------+ | ID | Name | Size | Share Proto | Status | Is Public | Share Type Name | Host | Availability Zone | +-----------+---------+------+-------------+-----------+-----------+--------------------+---------------+-------------------+ | 96368e55- | share01 | 10 | NFS | available | False | default_share_type | network.srv.w | nova | +-----------+---------+------+-------------+-----------+-----------+--------------------+---------------+-------------------+ |
[4] | It's OK all, you can use Manila Shared filesystem from Instances like follows. |
root@dlp ~(keystone)# openstack server list +--------------------+-------------+---------+--------------------+------------+ | ID | Name | Status | Networks | Image Name | +--------------------+-------------+---------+--------------------+------------+ | 9b506f0f-4c3b-458b | Ubuntu_1604 | SHUTOFF | int_net=192.168.10 | Ubuntu1604 | | -9213-17de1c4da03c | | | 0.6, 10.0.0.203 | | +--------------------+-------------+---------+--------------------+------------+ # allow access permission first root@dlp ~(keystone)# manila access-allow share01 ip 10.0.0.0/24 --access-level rw +--------------+--------------------------------------+ | Property | Value | +--------------+--------------------------------------+ | access_key | None | | share_id | 96368e55-c8a0-41ef-ab96-31300df0da34 | | access_type | ip | | access_to | 10.0.0.0/24 | | access_level | rw | | state | queued_to_apply | | id | e0e1389c-7186-469f-83d9-ee6b933b738e | +--------------+--------------------------------------+ # it's no ploblem if State turns to active root@dlp ~(keystone)# manila access-list share01 +--------------------------------------+-------------+-----------------+--------------+--------+------------+ | id | access_type | access_to | access_level | state | access_key | +--------------------------------------+-------------+-----------------+--------------+--------+------------+ | e0e1389c-7186-469f-83d9-ee6b933b738e | ip | 10.0.0.0/24 | rw | active | None | +--------------------------------------+-------------+-----------------+--------------+--------+------------+
root@dlp ~(keystone)#
openstack server start Ubuntu_1604 # confirm access Path root@dlp ~(keystone)# manila show share01 | grep path | cut -d'|' -f3 path = 10.0.0.50:/var/lib/manila/mnt/share-080ddcdc-bc89-4208-a9d5-563164eef482
root@dlp ~(keystone)#
ssh ubuntu@10.0.0.203 ubuntu@10.0.0.203's password: # mount Manila shared storage ubuntu@ubuntu:~$ sudo mount -t nfs 10.0.0.50:/var/lib/manila/mnt/share-080ddcdc-bc89-4208-a9d5-563164eef482 /mnt ubuntu@ubuntu:~$ df -hT Filesystem Size Used Avail Use% Mounted on udev 982M 0 982M 0% /dev tmpfs 201M 3.2M 197M 2% /run /dev/mapper/ubuntu--vg-root 7.3G 1.3G 5.7G 18% / tmpfs 1001M 0 1001M 0% /dev/shm tmpfs 5.0M 0 5.0M 0% /run/lock tmpfs 1001M 0 1001M 0% /sys/fs/cgroup /dev/vda1 472M 55M 393M 13% /boot tmpfs 201M 0 201M 0% /run/user/1000 10.0.0.50:/var/lib/manila/mnt/share-080ddcdc-bc89-4208-a9d5-563164eef482 9.8G 23M 9.2G 1% /mnt |